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Preparation of Bar Examination 
Questions 


A Pane. Discussion PRESENTED AT THE ANNUAL MEETING IN 
New York, Juty 15, 1958 


Remarks of Sharp Whitmore 


Chairman of California Committee of Bar Examiners and Now 
Chairman of the National Conference of Bar Examiners 


Chairman Powers has already referred to some of the activities 
of the National Conference of Bar Examiners, and I know many of 
you as examiners in your own state have been helped by the charac- 
ter investigation service and by the articles that appear in The Bar 
Examiner. Many I am sure have profited also from the questions that 
are made available through the Bar Examination Service Committee. 


We are hopeful today you will profit from another activity of 
the National Conference: one of its annual panel discussions on sub- 
jects of interest to bar examiners and to those interested in legal 
education. 


This is a workshop panel discussion. It is not one that will be pre- 
empted by the speakers sitting on the platform. We are hopeful that 
you will participate with us by making your appropriate comments 
and by asking questions of the panel members. 


Our panel discussion, as I am sure you know from the program, 
deals with the general subject, “Preparation of Bar Examination 
Questions.” Specifically, we are going to divide our discussion into 
halves. The first half deals with the subject of sources of material for 
bar examination questions and the second half deals with the subject 
of critiques within a board with respect to such questions and pro- 
cedures followed. 


To lead our panel discussion we are very fortunate in having with 
us four active bar examiners from four different states, together with 
a law school professor who doubles in brass as the Executive Secretary 
of the Bar Examination Service Committee. 


I think it would be best if we could hear initially from the three 
panel members who will be discussing generally the sources of ma- 
terial for bar examination questions. After they have finished I imagine 
other members of the panel will have comments or questions. Cer- 
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tainly we ask you to participate with us, asking questions or making 
comments. 

Our first speaker on the subject of sources of material for bar 
examination questions is Professor Godfrey who will tell us some- 
thing of the activities of the Bar Examination Service Committee and 
the services available from it. I am sure you have seen the catalogues 
of the Bar Examination Service Committee. Professor Godfrey will 
tell us how the Committee operates. 


Sources of Material for Questions 
Remarks of Edward S. Godfrey 


Executive Secretary, Bar Examination Service Committee 


I will combine my remarks with the usual annual report of the 
Committee which John DeGraff ordinarily gives. 


We are pleased to report that the past year has been one of con- 
tinued progress in the activities and usefulness of your Bar Exam- 
ination Service Committee. In the year that has intervened since our 
last meeting, we have distributed 953 questions to examiners in 33 
states. This represents a continued upward trend when compared with 
393 questions distributed during the first year of our activity, 817 the 
second year, 791 the third year, and 885 during the immediately pre- 
ceding year. 

Annexed to my typewritten paper', marked Appendix I, is a sched- 
ule showing the monthly and annual distribution of questions since 
the Committee started operations in December 1953. A total of 2,954 
questions has been distributed to examiners in 46 jurisdictions during 
that period. 


Most examiners know how the Committee operates but for the 
benefit of newly appointed examiners it may be helpful to explain 
that our Committee maintains a pool of bar examination questions 
and answers which has been assembled from contributions made by 
bar examiners and law school professors throughout the country. We 
receive approximately 800-900 contributions each year, winnow out 
the less useful ones and make available to examiners throughout the 
country the questions that appear to be most useful. A catalogue con- 
taining brief digests of the issues, and sometimes of the salient facts in 
the question, is distributed annually in December to all examiners. 
It contains approximately 50 pages and, while copyrighted, it is not 
available in libraries. If you are a new examiner, the catalogue is 
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sent to you in a handsome black binder. If any examiner does not 
have the catalogues previously published by the Committee, please 
let us know and we will be glad to send you the binder as well as the 
catalogues that have been published to date. 

The questions in the catalogue are organized by subject matter 
and any examiner can, by reviewing the catalogue, pick out the ques- 
tions that suit his particular needs and order accordingly. Some ex- 
aminers get ideas for questions from reviewing the summaries in the 
catalogue and draw their own questions from this material without 
ordering questions from the Committee. 

In general, examiners who have ordered questions from the cat- 
alogue have remained steady customers. They have kept coming back 
which may be an indication that they have found the questions help- 
ful in their work. Appendix II contains a list of the jurisdictions 
which have ordered questions from the Committee. 

We find that there are continued changes in the preference of 
examiners among subjects. The first eleven subjects in the order of 
popularity during the past year were: 


GMTV cea a RED Ce ee . 83 
ERLE OL IED AT A AEE sil iahainie tiscésiaet 72 
ES RIDES ARs OE a ED 66 
ATT RP AI Re aE A eee I a 66 
EROS CECE IRE em We re sabia it ROPE 2 65 
RII sinccostinicinntnghieasia ieitieehd tink nacralesiaplacactinlictiei intended co debangndaiaiiciai 59 
ERE OT SS CRIS SE eR ORC O RRe C ae en eC 53 
STIS att REINER Sat APE SA Pe eee TERS 50 
SaaS i siccchsttles Seenaecs Seatac Wiel aicheaisatananitciliasitiee 50 
i SAE RT AOR SAR OE Oe ee a eT 39 
IRIE aT ES OL: oP Re CEO 39 


The first three subjects the preceding year were: Evidence 65, 
Equity 61, and Contracts 59. Constitutional Law, which was eleventh 
in order of preference two years ago and sixth last year, has risen to 
second place, a quite surprising phenomenon. Torts, on the other hand, 
dropped from third place in 1955 to tenth in 1956, and to ninth place 
this year. It is somewhat surprising that the number of multiple 
choice questions ordered by examiners continues to be relatively small. 
A full breakdown of questions by subject matter appears in Appendix 
III which accompanies my paper. 


We have also found that certain questions, digested in the cat- 
alogue, seem to be more popular than others. One question has been 
ordered ten times and over 100 questions have been ordered four 
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times. It appears to us that the examiners who have used the Com- 
mittee pool regularly are becoming increasingly skillful in selecting 
what we consider to be the better questions. 


The heart of our program is the contribution of questions by other 
examiners. During the past year, seventeen jurisdictions have con- 
tributed to our pool, as shown by Appendix V. Appendix VI contains 
a cumulative table showing the number of questions contributed to the 
pool from the beginning of our program, expressed both in numbers 
and in percentages. 


Appendix VII shows the number and percentage of questions 
ordered from the Committee, grouped on the basis of the states which 
contributed these questions. You will note that of the twenty-five states 
and territories that have contributed to the Committee’s pool, some 
questions from each jurisdiction have been ordered by examiners in 
other jurisdictions. In other words, no State has made contributions 
which have been unused. This shows that we are engaged in a truly 
cooperative endeavor in which every examiner who contributes to 
the pool has the satisfaction of knowing that he has been of assist- | 
ance to some other examiner in another state. As in previous years, 
the contributions from California have been the backbone of the pro- 
gram and, as many examiners have learned, they are ideally suited 
for use in other states. Approximately seventeen percent of the ques- 
tions now in our pool were contributed by California and approx- 
imately twenty-five percent of the questions ordered by other exam- 
iners are California questions. 


We certainly hope that all examiners who have contributed 
questions and answers to the Committee will keep up the good work. 
Without these contributions we could not continue the program ef- 
fectively. New questions every year are indispensable to the function- 
ing of our program. 

It may be helpful to summarize some of the suggestions that have 
been made with reference to the use of questions from the pool. Many 
of the questions are excellent, some are perhaps only fair. All should 
be used with a decent skepticism, with full realization of the fact 
that some modifications may be necessary before a question used 
in one state can safely be used in another. Ordinarily, changes in places 
and dates are necessary. In many cases additional research may be 
necessary because some of the answers are not always fully docu- 
mented. 


Do not discard a question because it is longer or more com- 
plicated than you anticipated. As Len Young Smith pointed out a few 
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years ago, it is quite possible to make little ones out of big ones and a 
single complex question may be redrafted to make two or three less 
complex questions. Most of the questions in the pool involve problems 
requiring analysis and reasoning and, with a little extra work on the 
part of the ordering examiner, they can be adapted for use in almost 
any state. 


On the statistical side of the Committee’s work, we have for the 
second successive year made a detailed study of the performance of the 
individual questions on the examinations conducted by two states by 
correlating the performance of each question with the examination as 
a whole. These studies are still in progress in relation to one state 
but in the other state the analysis shows that there has been a 
marked improvement in the year that has intervened since the first 
analysis was made. This type of study is probably the most helpful way 
of improving a bar examination and we hope that more states will 
use the statistical services that are made available by the Conference 
without charge. 


In concluding this report, I cannot refrain from quoting the fol- 
lowing excerpts from an address, which came to my attention quite 
accidentally, delivered on December 21, 1936, by Leon Green, then 
Dean of Northwestern University Law School at Chicago. In that 
address, some twenty years ago, Dean Green made the following ap- 
praisal of bar examinations and bar examiners: 


“Examination is a part of the teaching process. There it serves 
a valuable function. Utilized elsewhere, it is of value only where 
mere routine is the subject of inquiry. Separate it from the student- 
teacher relation and it has little or no part to play in the deter- 
mination of the high intellectual and moral qualities which should 
be required of lawyers. Except as bar examinations involve 
relatively unimportant legal routine and technique, they almost 
completely miss their mark. 


“Bar examiners have merely aped the professors. With rare ex- 
ception, they are qualified neither to prepare questions nor to 
grade answers upon the important levels and over the whole 
field of the law. However able they may be as lawyers, how- 
ever earnest and well intentioned—and all whom I know so 
qualify—examiners cannot afford the efforts required to prepare 
themselves, or give the time to conduct examinations that will 
function for the purposes desired. 

“Bar examinations undermine and frustrate the efforts of the 
universities to improve legal training. They are unrelated to al- 
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most every function that a lawyer has to perform. They fail to 
cover many of the most important fields of legal study and thus 
restrict the curricula of the law schools. They narrow the range of 
the student’s interests, and limit the scope of his studies. They 
place emphasis upon the least important phase of his training. 
They are an unintelligent attempt to do what needs to be done 
with the utmost intelligence. Their best results are trifling. 


“And worst of all, bar examinations make it profitable to operate 
scores of proprietary law schools and quiz courses throughout the 
country, whose only excuse for existence is to prepare students to 
pass bar examinations. Approximately fifty percent of the law 
students of the country are attending law schools unapproved by 
the American Bar Association, preparing desperately to pass the 
futile examinations required for admission to the bar. Many of 
them could not be admitted to the approved university schools, 
and those who could are receiving inferior training. Nevertheless, 
they are successfully passing bar examinations and being admitted 
to overcrowd and to a great degree demoralize the profession.” 


No one, I believe, would make such an appraisal today. Much of 
the credit for the progress that has been made during the past two 
decades must go to the National Conference of Bar Examiners which, 
since its organization in 1931, has served as a clearing house for the 
exchange of ideas and information which has brought about such a 
marked improvement in the field of bar examinations. 


Moperator Wuitmore: Thank you very much. I am sure we are 
all impressed with the extent to which the Bar Examination Service 
Committee’s work has been accepted by the examiners in so many 
states. It certainly has grown. It must be good or it would not have 
grown to that extent. I am hopeful that each of you who are not com- 
pletely familiar with the work of the Bar Examination Committee 
and the services available from it will take the opportunity this after- 
noon, either during our panel discussion or afterwards, to direct your 
questions to Mr. Godfrey. He has indicated he will be available, not 
only during the panel discussion but for a period of time afterwards, 
to discuss with any of you problems or ideas that you may have in 
connection with the committee or its work. Needless to say, there are 
a number of sources of material for questions other than the Bar 
Examination Service Committee. 


Mr. Arthur Nighswander is a member of the three-man board of 
bar examiners operating in New Hampshire without clerical help. 
He is an experienced examiner, having been once since 1943, I 
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believe. We are looking forward to calling upon his lengthy experi- 
ence as an examiner to learn how the examiners in New Hampshire 
have resolved the problem of getting information for bar examination 
questions. Mr. Arthur Nighswander. 


Remarks of Arthur H. Nighswander 


Member, New Hampshire Board of Bar Examiners 


I shall never understand why your Chairman, Mr. Powers, asked 
me to speak for about twenty minutes on the subject “Sources of 
Material for Bar Examination Questions.” Certainly, it is not be- 
cause the New Hampshire examiners have done such an outstanding 
job in the preparation of questions. The three bar examiners, who 
are all busy lawyers, make up the questions for the examination and 
correct the papers themselves. It has been the practice to give an 
examination of ninety questions in eighteen hours in sessions covering 
three days, allowing twelve minutes to read, analyze and answer each 
question. This year the number was reduced to eighty-four questions. 
Perhaps Mr. Powers’ invitation is explainable by the fact that the 
Commonwealth of Massachusetts once claimed to own that portion of 
New Hampshire situated south of the headwaters of the Merrimack 
River which includes the community in which I live, and I am sure 
that the people of Massachusetts have always secretly admired the 
independence of spirit of the people in New Hampshire who had the 
courage to break free from the bonds which bound them to the Com- 
monwealth. I am sure that Mr. Powers knew that I could not con- 
tribute very much of value to this discussion, other than to pose a few 
problems and to demonstrate how much more enlightened Massachu- 
setts is than New Hampshire by being able to combine all phases of the 
bar examination in twenty questions instead of ninety. 


I received my legal education at Columbia Law School where a 
professor generally considered himself a failure if he did not leave 
his class each morning hopelessly confused by questions which had 
been raised and remained unanswered. The philosophy of Prof. Karl 
Llewellyn was particularly summed up in an incident when, in answer 
to a student who sought some direct statement of what the law is, the 
professor replied: “I can best answer your question by asking you two 
questions.” 


As far as I can see, there is nothing humorous about this topic, at 
least as far as bar examination questions are concerned. There may be 
many humorous answers, such as one answer to the question, “What 
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is a hypothetical question?” The answer given was: “A hypothetical 
question is a question which is generally asked of infants, experts and 
other non compos mentis.” I am sure that this sometimes seems to 
apply to bar examiners because it is very easy to think of questions 
but much more difficult to find the answers, and no question should 
ever be asked if the bar examiner himself does not know the answer. 
It has been said, with some truth I believe, that one fool can ask more 
questions than ten wise men can answer. I do not think I would be 
doing justice to my subject if I were not to consider in my discussion 
only such questions as may have answers, and that such answers 
may be within the grasp of the knowledge and understanding of the 
bar examiner. 


I believe a bar examiner should first ask himself what the purpose 
of the question is as this may have some bearing upon where the search 
is directed. For example, is the purpose of the question to test the legal 
education of the applicant? If this were so, and this were the only 
reason, I would suggest that it might be proper to ask such questions 
as, “Write fifteen minutes on the principles of agency as applied to 
the law of contracts.” Is it to test legal aptitude? If it is, then I doubt 
whether bar examiners such as we have in New Hampshire possess 
the aptitude and ability themselves to ask questions to test legal 
aptitude. On the other hand, it seems to me that there is something to 
be said along this line because I am sure that one of the main purposes 
we have in mind in making up our examinations is to test a person’s 
ability to analyze a complex situation. I recall one question which I 
thought was a very good question, and from the standpoint of weeding 
out the sheep from the goats it seemed to work very well. But I have 
since read in some learned treatises on bar examination questions that 
this was not a particularly good question because applicants for ad- 
mission to the bar are not supposed to know practical things. Briefly, 
the essentials of the question were as follows. “A, B and C wanted to 
go into business together. A was elderly and had the financial means 
to back the business but did not want to be active. B was a man of 
considerable experience who had the knowledge and ability to run 
the business and had some money, but not nearly as much as A. 
C was a young man whom B wanted some day to see in control of the 
business. C had no money. If A, B and C came to your office and asked 
your advice as to whether or not they should form a corporation or 
a partnership, what would you tell them and why? What would you 
think their various interests should be? Discuss fully, including any 
tax angles that may occur to you.” 
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Perhaps the purpose most commonly stated is to test familiarity 
with local law, and there is no doubt that as far as New Hampshire is 
concerned up until the last ten or fifteen years this was undoubtedly 
the paramount purpose. We have a case in New Hampshire, for ex- 
ample, which held that the acceptance of a partial payment on a 
liquidated debt in full settlement constitutes a binding agreement 
based upon good consideration, because a bird in the hand is worth 
two in the bush. This question has been asked innumerable times, and 
almost invariably, no matter how the facts are worded in the question, 
the answer is, or at least has been given, full rating if the applicant 
cited Edgerly v. Barker. It was thought for years that a person could 
read a selected list of 600 New Hampshire cases and, whether he had 
been to law school or not, could pass the bar examination with flying 
colors by citing these cases. This is no longer true. It seems to me that 
a bar examination question, to be a good question, must be a com- 
bination of all three purposes — to test education, aptitude and 
knowledge—and to find such questions is a challenge to the examiner. 


What is a good question? In my opinion, a good question must be 
clearly and concisely worded. It should contain one or preferably more 
points of law susceptible of answer based upon logical reasoning. The 
answer should not be dependent on a statute unless the statute is set 
forth in the question, and it should be the type of question which will 
give a spread in the marks and will not be too difficult for the examiner 
to grade. Where does one find such questions? In the first place, previ- 
ous bar examinations are an excellent source. One should be careful to 
get questions that have not been given in recent years, so that re- 
peaters would not have an advantage, but I believe it is perfectly all 
right to take questions from previous examinations in states where 
they are not published, as in New Hampshire, possibly rewriting them 
and changing some of the essential points, not for the purpose of 
tricking the applicant, but to bring them up to date and to improve 
the quality of the question. Questions, however, should be taken only 
if they have given good results. If ninety questions are to be given 
in our state, it is almost essential that some of the questions be from 
previous examinations. In states that have long, involved questions, 
which the applicant is given from a half-hour to an hour to answer, I 
would say that the previous examinations should be used only as a 
source of inspiration for writing new questions. 


Next in order of importance, I would say that the Bar Examination 
Service is a very fertile source of questions, once one becomes ac- 
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customed to using it. It is not necessary that the questions be used 
verbatim, but they can be adapted, shortened, rewritten or changed 
in any way, although in some instances we have given the questions 
without any change whatsoever. They should, however, be checked 
against the local law, because there is nothing more disconcerting than 
to have an applicant answer a question by saying: “Oh yes, this is the 
point involved in the New Hampshire case of Smith v. Jones,” espe- 
cially when the bar examiner has never heard of the case of Smith v. 
Jones and doesn’t know whether it applies or not. I also find that the 
catalog put out by the Bar Examination Service Committee is very 
helpful in stimulating ideas because it is essential, in trying to cover 
all the major fields of law, that some question be included in the 
examination on various important points. By reading over the head- 
ings and the synopses of the questions in the Bar Examination Service 
catalog, one very often discovers that some particular phase of a subject 
is not being covered in the examination and it is then easy to include 
a question on this point. 


I find that the American Law Institute Restatement is excep- 
tionally good as a source for examination questions. There are in- 
numerable illustrations which adapt themselves to making up a hypo- 
thetical set of facts. Sometimes two or three may be combined in one 
question by careful wording. The Restatement is being cited by the 
courts more and more frequently, and I assume that much more ref- 
erence is being made to it in the law schools every year. 


Although there has been considerable criticism of using cases 
from one’s own practice and it may be a rather dangerous thing to 
do, nevertheless I believe that, with care, examination questions may 
be developed from one’s own practice. For example, it seems to me 
that a lawyer who has had a case in the State Supreme Court knows 
all of the issues that were involved and how they were raised in the 
proceedings. He can very well use a set of facts based upon the par- 
ticular case, if it were one of special interest, to make a very good 
question. As a matter of fact, a case which our office tried a few years 
ago was used last year as the case in a moot court competition in one 
of the leading law schools in the country. The facts were too compli- 
cated to be used without change in a bar examination question, but 
they were of such an interesting nature I am sure a good question 
could be made from them. The case involved a suit against an airport 
and a farmer. The case against the airport raised the issue as to the 
liability of the operators of the airport for the acts of a student pilot 
who was not an employee or agent, but who was allowed to take off 
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on the south runway in violation of the rules and regulations of the 
airport, on a day when the wind velocity was below five miles per 
hour. The airplane failed to gain altitude quickly enough and fright- 
ened a horse a farmer was using in a field. The horse ran away toward 
the barn and on the way the hub of a wheel of the hay rack struck a 
child playing beside the road on the farmer’s property, the parents of 
the child being his invited guests. The child received a fractured verte- 
bra and was almost completely paralyzed. To say that this case should 
not be used because it originated in my own practice seems to me 
unfair. However, if I were to use the facts in this case to make up a 
question, I would have to be sure that I did not make it too tricky or 
expect that the person answering the question would know as much 
about the issues involved as we did after intensive study. 


Recent cases from the State Supreme Court are a fertile source of 
bar examination questions. It seems to me that they should not be 
given without adequate safeguards, however, because it is not fair to 
expect that an applicant would know all of the recently decided cases. 
However, many of the recent cases do have interesting angles or 
facts which can be incorporated into a question, provided sufficient 
opportunity is given to answer the question on the basis of sound 
reasoning, without agreeing necessarily with the result of the Supreme 
Court. As a matter of fact, most of us practicing lawyers do not agree 
with all of the decisions of the Supreme Court and when we have 
argued a case, and lost, I am sure we are convinced that the reasoning 
on the losing side was as cogent and as impressive as that on the win- 
ning side, but for some reason or other failed to convince the Court. In 
other words, such a question should be marked more on the basis of 
reasoning than on the basis of knowledge of the particular decision. 


It is also possible to make up questions with purely hypothetical 
facts. I would say that in general this is what we do, and even when 
using actual facts we often change them a little in order to make the 
issues clearer. 


Another source of material is found in the digest of local law. Here, 
again, a statement of facts in some case should not be taken verbatim 
from the digest, of course, but by reading several cases in the digest 
involving various ramifications of a particular issue it is quite often 
easy to work them into a single question. 


Finally, there are textbooks which many bar examiners use. Al- 
though I have no objection to using them or Law Review articles or 
any other sources which may be available, I would say that if you 
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have used all of the other sources I have mentioned and have not as 
yet come up with a question, your usefulness as an examiner must be 
at an end and you should immediately submit your resignation. 


There is one other point I believe I should mention, and perhaps I 
should have covered this first. Having in mind the various sources 
from which the questions may be derived, there is a certain technique 
involved in obtaining the questions. In the first place, you should 
determine the field to be covered. For example, are you looking for a 
question in torts, equity, procedure or some other field? When you 
have decided that you are looking for a question in the field of torts, 
for example, how many questions on the bar examination are to be 
allocated to this subject? The questions should be apportioned among 
the various fields of law in the order of their importance. For example, 
for many years the same number of questions was given in the New 
Hampshire bar examinations in criminal law as in torts or property. I 
have always felt that this was wrong; that many students no longer 
take criminal law; that many lawyers have no practical knowledge of 
it; and that it is unfair to emphasize this subject. I would therefore al- 
lot more questions to those fields which are more prominent in prac- 
tice. Suppose you are going to write some questions on the subject 
of torts. You might then subdivide the topic into such matters as land- 
lord and tenant, intentional wrongs, negligence, injury to guests, li- 
censees or trespassers, causation, damages, and other miscellaneous 
subjects such as assault and battery, libel and slander, etc. After the 
subject has been analyzed in this way, you may then determine how 
you may combine various parts of the subject into one question and 
cover the field generally without omitting certain important phases of 
it. Otherwise, there is a tendency to overemphasize certain aspects, 
such as proximate cause, and neglect others. It is also important that 
a proper balance be kept between the essay type or analysis questions 
and the so-called informational questions. Personally, I prefer a proper 
balance but it is most difficult to achieve. In fact, a bar examination 
question very often cannot be evaluated until after it is given and the 
answers have been read, at which time it may occur to you that the 
question was either poorly worded, was tricky, was too easy, or was 
too hard. Unfortunately it is then too late. 


In closing, I would like to paraphrase the words of a professor 
whom I greatly admired. He was once talking in class about the possi- 
bility of success in practice. He stated that it was not the lawyer who 
knew the law or the lawyer who knew where to find the law that 


13 











was successful, but it was the lawyer who knew what law to find. 
Perhaps it is not as much a problem of knowing the sources of material 
for bar examination questions which makes a bar examiner successful; 
it may be in knowing what questions to look for. 

Moperator WuitmoreE: Thank, you, Arthur, very much. 

Our third speaker, in connection with the subject of sources of 
material for questions, will be Mr. Joseph Irion Worsham of Texas. 
Mr. Worsham has agreed to discuss with us the pros and cons of pur- 
chasing questions as well as considerations involved in the drafting of 
questions by members of the Bar Committee itself. 


Remarks of Jos. Irion Worsham 
Member, Texas Board of Bar Examiners 


When Mr. Powers asked me to appear on this program and sought 
to give me some idea as to the type of discussion desired, he asked me 
to imagine that I had just been appointed a bar examiner and was 
told that I would need to provide a number of questions for an 
examination on the following Monday. While this may be a bit more 
dramatic than what regularly occurs in the lives of bar examiners, I 
am sure I speak for most of us when I say that at periodic intervals 
we awake one morning with the startled realization that in all too 
short a time questions will be due for the next examination. It was, 
therefore, not at all difficult for me to imagine the situation Mr. 
Powers posed since I regularly experience it, to an only somewhat 
lesser degree, three times a year. Mr. Godfrey has told you about the 
availability of the questions from the Bar Examination Service, and 
the shorthand answer to the problem put by Mr. Powers would be to 
resort to that field because it has been my experience that time is a 
factor which cannot be ignored in the preparation from the primary 
sources of adequate bar examination questions. 

Mr. Nighswander has discussed with you some of the sources to 
which our theoretical bar examiner might turn. There is another 
source from which to obtain bar examination questions which might 
be mentioned, one to which the imaginary character suggested could 
not resort because of a lack of time, but which is used in some juris- 
dictions, namely the obtaining of questions through purchase from law 
school professors and others who might engage in furnishing questions 
for remuneration. Such purchases might be deemed acquisitions from 
secondary sources in that they merely pass on to someone else the 
obligation of mining the basic material for the wherewithal with which 
to compose a question. 
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There are advantages to such a procedure. One is purely personal, 
namely, the saving of a great deal of time to the examiner or other 
person charged with the preparation of a section of the examination. 
Another advantage probably lies in the circumstance that, in most in- 
stances, such purchased questions, having been prepared by experts, 
would normally be superior in quality, judged by a purely profes- 
sional standard, to those prepared by examiners. There is one other 
consideration which should be mentioned also. The grading process 
should be as objective as possible, and I suppose that one serving in 
such endeavor can perhaps do a better job when his relationship to a 
question has been as impersonal as the relationship of those whose 
answers he grades—a position which cannot be obtained if he has, as 
is often true, fathered the question in blood, sweat, and tears. 


While I cannot speak from personal experience, since questions 
are not obtained in this fashion in Texas, nevertheless it is my view 
that certain practical considerations outweigh the benefits mentioned 
and make the obtaining of questions through purchase a less desirable 
practice than the composition of questions by a reasonably competent 
board of law examiners willing to devote an adequate amount of time 
to the task. There is expense involved, which, however, may be re- 
garded as incidental; certainly those who prepare the questions earn, 
and are entitled to receive, compensation. The saving of time is not 
100% , however. While a question which is purchased should certainly 
be accompanied by an analysis and citation of legal authorities, a 
further check on the law of the specific jurisdiction, especially as to 
the statutory law, would seem to be a necessary precaution. More 
particularly, time must be spent in advising those from whom the 
questions are obtained as to the desires of the examiners in regard 
to course coverage, in avoiding duplication and observing time limita- 
tion standards, etc. There is some concern as to security measures. 
Leaks as to questions for examinations have occurred in the past, and 
the responsibility in the last analysis, regardless of the persons in- 
volved, rests with the board of law examiners. A variation of this 
problem relates to the preference which may be given some applicants. 
Questions would generally be obtained from teachers in the law schools 
in the state in which the board sits, and, therefore, whence usually 
come the majority of applicants. Through a tendency of the questions 
to relate to those given in the law school examinations, or at least to 
concentrate upon the points receiving the greatest attention in these 
law schools, an advantage might be given applicants coming from these 
schools. As to the questions themselves, I believe that they should 
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depart from the typical law school questions, not in form or pattern, 
but in content. Surely law examiners in active practice, seasoned by 
experience in bar examination technique, should be able to prepare 
questions which in content and subject matter, if not in phraseology 
and technique, are much more suitable for the purpose desired than 
are those prepared by others who, though experts in the scholastic 
field, do not have the background mentioned. Another problem appears 
to me to be that of working questions procured from a number of such 
sources into a comprehensive, well-organized examination. While, of 
course, some such questions can be well introduced into the pattern 
of an examination, it would appear difficult to compose a well-organized 
and comprehensive examination entirely or largely out of such pur- 
chased questions which, though perhaps individually gems of bril- 
liance, nevertheless do not fit well together. I should add in conclusion 
on this point that, as is probably obvious already, I generally feel that 
attorneys who are chosen, and agree to serve, as bar examiners 
should be sufficiently competent to prepare satisfactory questions and 
willing and able to spend the time necessary to do so. 


Turning to the problems of a board of law examiners as a whole, 
in its perennial search for proper questions for examination, if the 
board has determined for the above reasons or others not to obtain 
questions by purchase, it is faced with the necessity of securing such 
questions through its own personnel, who work individually or with 
the aid of clerks or assistants and with such help as it wishes to 
obtain from the pool of the National Conference of Bar Examiners. 
Most states by statute or court rule prescribe the subjects to be cov- 
ered; the board is thus limited to specific fields. The initial step is, of 
course, the division of labor, which usually takes the form of assign- 
ment of subjects. In this task, a voluntary division or allocation, to the 
extent it can be accomplished, seems by far the preferable method, 
for it is obvious that a man’s performance will attain a higher stand- 
ard in those fields in which he is best acquainted and which he there- 
fore seeks, and that in working where he is interested he will do a 
better job. For the latter reason, however, some rotation and trading 
of subjects from time to time is desirable, for after three or four years 
enthusiasm may lag and interest can be rekindled in new pastures. 


So then the individual examiner comes to grip with the problem 
of composing a series of bar examination questions. His sources are in 
general whatever can suggest to him a facile combination of points, 
arrayed in factual settings and covering appropriate sections of the 
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particular subject or subjects in question. There is no problem about 
identifying or locating individual points of law. There are thousands 
of them in every field. There is no trouble about presenting any one 
individual point in factual dress. The trick is in selecting points that are 
not too elementary, yet not too refined, not too easy, and not too 
difficult, and combining them in such a way against a factual back- 
ground that the question is fair, the situation presented is plausible, 
and its legal points dovetail in an acceptable fashion. Textbooks, the 
Restatement of the Law, the legal encyclopedias, reported cases—all 
give the raw material with which to work. They all, when opened at 
the right place and at the right time, can suggest the germ of an idea 
and, of course, are essential spurs to the active operation of the exam- 
iner’s mind, but I am convinced that in the last analysis the composition 
of a satisfactory law examination question is a type of literary effort, 
and that one can no more bring forth a fine bar question by consulting 
a source that he can call forth a poem by viewing a beautiful scene or 
a Grecian urn. Proficiency in the practice, a great store of legal knowl- 
edge, even excellence in the field of brief-writing, do not in any wise 
guarantee an adequacy in the preparation of examination questions. 
The law examiner will never rank with the essayist and short story 
writer in the field of literature, but he is, nevertheless, engaging in 
composition which must emanate from within and those of you who 
with me have burned the midnight oil, waiting for the muse to strike, 
know that the ultimate source, while inspired and aided by many helps, 
must be the ingenuity, such as it is, of the examiner himself. 


As far as my individual experience is concerned, I would lump 
what might be considered a number of sources into one which, for 
want of a better name, I would call daily legal experiences. If the 
examiner, constantly aware that a question submission deadline lies 
somewhere ahead, will, as he goes about his daily tasks of advising 
clients, writing and construing wills and contracts, drafting plead- 
ings, briefing points, reading advance sheets, weekly services, and law 
reviews, etc., keep in mind the subdivisions of the subjects he must 
cover, he will find that the sources come to him, so to speak, instead 
of his having to seek them out, and, if he follows this practice, an 
accumulation of thoughts and points and half-phrased questions will 
grow in the bottom drawer for future use. There’s never enough, 
please understand, to meet the deadline without a later concentrated 
search, but a large part of the task can be cared for in this manner, 
and the so-called sources best exploited for what they are—namely, 
touchstones to fire the ingenuity of the examiner. 
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General Discussion 


Moperator WuitTmore: Thank you, Mr. Worsham. Being from a 
state that purchases questions for use by the examiners in bar exam- 
inations, I think I should like to start the comments with respect to the 
first portion of our program by discussing the experience in California 
very briefly with respect to this source of material for questions. 


I certainly must agree with Mr. Worsham that one of the negative 
considerations in connection with the purchase of questions is the 
cost. It becomes a substantial cost, particularly when you purchase 
more questions than you ultimately use in your examinations. 


I do not believe, at least it has not been our experience, that 
there is a security problem in connection with the purchase of ques- 
tions. We attempt to handle this in a number of ways. First we buy 
questions only from professors of the law schools outside the State 
of California. Secondly, we buy two or perhaps three questions for 
each one we use. Thirdly, we very often substantially redraft the 
questions which we purchase. Lastly, in California we do not neces- 
sarily use the questions which we purchase on the next examination 
after they have been purchased. 


We have found no breaches of security from the law school pro- 
fessors from whom we buy them. Our experience has been a rather 
favorable one. We find that we do not seem to run out of ideas this 
way. We can incorporate our ideas into the format or framework 
of the questions which we have purchased. 


As a result of purchasing questions, we may very well have a 
problem, although I do not consider it a serious one, with respect to 
the organization of an examination that is integrated throughout. We 
order many questions, as I indicated. As a result our choice is rather 
great in working together into a comprehensive integrated examina- 
tion questions in each of the subjects to be covered. If we find that 
we do have problems in connection with the integration of the ques- 
tions we have, we can always—and do—redraft them to include new 
points, redraft them to exclude points that might be duplicated in 
other questions, or perhaps completely discard a series of questions 
which we have purchased and draft our own if we find that advisable 
under the circumstances. 

We have not had too much of a problem in getting the types of 
questions that we want. I think the main reason for this is that in 
California we have drafted a very long, rather detailed letter of in- 
structions to law professors from whom we solicit questions. If we do 
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not get what we want we do not order again from that professor, or we 
redraft the questions which he has submitted to us. 


There certainly are advantages in connection with the purchase of 
questions. We find we get many new ideas. We get new formats into 
which we can put our own ideas with respect to particular questions. 
Likewise, as Mr. Worsham pointed out, there probably is a time avail- 
ability to the committee as a result of our purchasing questions which 
would not otherwise exist. 


That very generally has been the experience, at least as I see it, 
in connection with the purchase of questions in California. 


Do we have other comments from the panel members or the 
members of the audience with respect to the first half of our general 
panel discussion today on the source of material for questions? 


Ernest Scorr: I just wondered whether there was any general 
area of compensation that you had for buying questions? 


Moperator WuitTmore: Needless to say the compensation paid a 
law school professor for questions has increased over the years and I 
would think now that reasonable compensation, at least what we con- 
sider to be reasonable compensation, for the question itself and a 
detailed and annotated analysis and answer would be in the neigh- 
borhood of $50. 


Mr. Scott: Do you go to the particular professor knowing that he 
is a very learned person and qualified in the field and ask him to 
submit questions, or do you have definite ideas for questions in a par- 
ticular area that you might ask for? What I am trying to reach for is 
whether you just ask for questions and then buy out of the group that 
is submitted or whether you aim towards particular questions and 
then buy? 


Moperator WuitTmMoreE: The extent to which we use a rifle rather 
than a shot gun, Mr. Scott, is this: We will request questions generally 
within the field of torts from torts professors at the accredited law 
schools outside the State of California. We will not instruct the torts 
professors specifically as to whether or not we want the question to deal 
with negligence or libel or slander or any particular portion of the 
field of torts. 


We buy the question. When we receive it, we do not reject the 
question if it conforms to the instructions we have given to the pro- 
fessor. We go back time and again to the same professors when we 
find they do a good job, an imaginative job. 
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Do we have any other questions or comments with respect to this 
first half? 

JosepH A. Mitiimet of New Hampshire: I am on Mr. Nighs- 
wander’s board from New Hampshire. Our problem is quite different 
from California. This year we had 32 applicants. As you yourself know, 
we have no clerical help, and I conducted an experiment this year. I 
went back to law school and got some old examinations and used a 
few of the questions, and I would like to ask if any of the members 
of the panel or of the audience have used old examinations of that 
nature and what success they have had with it because it was an 
experiment with me, and I am not sure of the result. 

Mopberator WHITMORE: I assume you want that question directed 
to a member of the panel other than Mr. Nighswander, with whom I 
am sure you have already discussed it. 

Mr. WorsHam: I have used that source and I think any other you 
can possibly name because, as I suggested before, anything that gives 
me a germ of an idea and a combination of two to three to five points 
across lines within a course is a useful source. 

Mr. Goprrey: The Harvard Law School has generously made 
available to the Bar Examination Service Committee its old exam- 
ination questions. We have had requests for perhaps a dozen Harvard 
Law School questions since that offer was made to us by Dean 
Griswold. 

Two or three of these appear to have been used. They tend to be 
rather long complex questions, which is, I suppose, the reason why 
they have not proved particularly attractive to too many examiners. 

There is a source of law school questions there which is avail- 
able to examiners throughout the country. I think many of the ques- 
tions are excellent. However, the analysis of the answers has not been 
made available. 

Moperator WuitTmore: Are there any other questions or com- 
ments? 

The second portion of our discussion on the preparation of bar 
examination questions deals specifically with the subject of critiques 
of questions within a board after drafting and before inclusion in an 
examination. 

We have three distinguished members of the bar and bar exam- 
iners to discuss this subject with us. Our first panel member will be 
Mr. Ernest Scott of the Pennsylvania Board of Bar Examiners. Mr. 
Scott has agreed to direct his remarks, at least in part, to problems that 
exist in connection with the phrasing of questions. 
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Critiques of Questions Within a Board 
After Drafting and Before Inclusion 
In an Examination 


Remarks of Ernest Scott 
Member, Pennsylvania Board of Law Examiners 


I am afraid that the only function which I will serve this afternoon 
is to make the number of commentators appearing on the second half of 
the panel equal to the number on the first half. I am a newcomer to this 
exalted world of bar examiners—my appointment is about a year old— 
and it came about through the operation of the ABA Standards—Provi- 
vision 4 which suggests it is not wise for a trustee of a university with a 
law school also to be a bar examiner passing upon the admission of 
graduates from that university's law school. This has caused my dis- 
tinguished predecessor, Arthur Littleton, to resign, which event goes to 
prove the validity of the time-tried principle—that when you intend to 
shoot the ogre in front of you and do so—you are nevertheless guilty of 
murder even when it turns out that the victim was not an ogre at all 
but one of your best examiners. This is not intended as a collateral 
attack upon Standard No. 4—which in the long run is doubtless a 
salutary provision—but a wistful comment on one of its unhappy 
short term results. Into the Littleton vacancy came I. Now having ac- 
counted for my presence—courtesy of the ABA Standards and the 
Committees which evolved them—and beckoned irresistibly by Mr. 
Whitmore I will pass to my announced subtopic “The Phrasing of 
Questions.” 


Standard 11 reads “Bar Examinations should be of such a type 
that adequate preparation to pass them will have educational value.” 
On top of this lofty ideal, Standard 12 provides (as you well know) 
“The Bar Examination should test the applicant’s ability to reason 
logically, make an accurate analysis of the problems presented to him, 
and demonstrate a thorough knowledge of the fundamental principles 
of law and their application. The questions should not be designed 
primarily for the purpose of testing information, memory or ex- 
perience. No deceptive questions shall be asked.” If these ends are to 
be accomplished, obviously the phrasing of the questions is of major 
importance. 


After the examiners have come up with a challenging problem— 
and the first-half panelists have developed a number of ways to do 
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that—they have to be sure that the problem is stated in a natural, 
realistic way so that it is neither entirely buried nor too obvious and 
so that some stray fact will not beckon the unwary down an unintended 
avenue away from the beautiful puzzle intended. 


This is not easy. Very few people can say what they mean. Today 
with television, radio and visual education coming more and more 
into prominence, the art of developing a strong clear style of writing 
becomes more and more difficult to acquire. 


The working and reworking of questions by an earnest and con- 
scientious group who are intent on producing an examination which 
will “. . . test the applicant’s ability to reason logically .. .” is today’s 
necessity and the whole group—board members as well as examiners— 
must participate in the reworking process for the best results. There 
are some procedures of our Pennsylvania Board the clear wisdom 
of which has not, in my short period of service, yet been revealed to 
me; but of this one thing I am sure, that a Pennsylvania bar question 
which appears on any examination has been kicked around by more 
people than any dog or cat of my ken, be that animal living or dead. 


Our setup is a board of five lawyers appointed by the Supreme 
Court from various sections of the state. The appointees are non-sal- 
aried. They are assisted by a paid staff consisting of four examiners 
and a supervising or chief examiner. This group is outside of, and in 
addition to, the administrative and clerical force which handles the 
office matters and procedures of the board. The group I am talking 
about, the four examiners and their chief, are professional personnel 
who deal with the initial development of questions and the marking 
of the papers under the supervision of the board. They are all lawyers. 
Three of them are in active practice—one of the three was also a 
college teacher of Blackstone and Business Law for upwards of ten 
years. The fourth is a career Deputy Attorney General of Pennsyl- 
vania; the fifth, a Ph.D., is a college teacher of Constitutional Law 
and the co-author of a recent text book on that subject which, in its 
class, has proved to be a best seller. 


The supervising examiner is, I believe, unique to Pennsylvania. 
He is a most important cog in our bar examination machinery. This 
post is held by a man of judgment, maturity and experience. He en- 
courages and controls the examiners, balances their enthusiasms and 
their prejudices, takes advantage of their strengths and bolsters their 
weaknesses. He makes the subject assignments, preserves standards 
and prevents duplications. 
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This professional group give on the average close to one-half of 
their working time to board work—preparing questions, in confer- 
ences concerning them and bar examination problems, and in marking. 


The board requires a general knowledge by the applicants of six- 
teen specified subjects. Every examination covers all of these subjects 
and each examiner must come up with six questions (and a couple of 
spares) on the subjects assigned to him, running from three to five 
in number. By a given date, about two months before the examination, 
each examiner submits copies of his questions to his fellow examiners 
and to the chief examiner, who has already become familiar with most, 
if not all, of them as he has with rare exceptions passed on their selec- 
tion and in varying degrees assisted in their preparation. Then these 
five men, with the supervising examiner presiding and participating, 
get together for a day or so and hammer at the substance and form of 
each question until they have agreed upon four sets of six questions 
each, plus a few in reserve. These questions, together with support- 
ing briefs covering the law on the points involved, are then circulated 
among the board members about two weeks in advance of a two-day 
session devoted exclusively to consideration of every detail of the 
questions already culled over by the examiner conference. At this 
session the five board members meet with the five examiners. To a 
newcomer this is a fascinating experience. I firmly believe I have 
learned and relearned more law in these sessions than in any other 
comparable period of time in my career. The discussion ranges from 
A to izard—from substance to form and back again. 


It is unusual for a single question to get by in these sessions 
without some change, which change is frequently substantial. The 
change may be in the interrogatory, in the construction, or both. It 
may be in the deletion of issues, in the addition of facts or both; and 
as the King of Siam would say— et cetera, et cetera, et cetera. It also 
may be that the question is tossed out altogether and a call is made 
on the reserves. At the board session last month, for example, this 
happened on three separate occasions. 


Then, after the board has approved the twenty-four questions for 
the oncoming examination, the chief examiner together with each 
examiner on the latter’s set of six of the twenty-four does a final 
editing and polishing job which invariably proves to be worth the 
effort. This means that in addition to the examiner who puts the 
question into its original form, nine other minds have studied the 
question and attempted to eliminate flaws from it and improve it gen- 
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erally. Thus after birth each question has undergone at least two major 
operations and one minor one at the hands of nine doctors besides the 
one who brought it into the world. Is it worth all this time and trouble? 
Our board thinks so and thinks so unanimously—but that’s a matter 
of opinion on which we may be wrong. 


Now what do we do about the scope of the facts stated in the 
question—do we deliberately limit ourselves only to relevant facts or 
do we deliberately include irrelevancies? As on most of these points, 
it’s difficult to state a general policy or rule. I doubt really that one 
can be stated which, on study, could not be said to have been dis- 
regarded as often as followed. We have used questions where the basic 
challenge for the applicant is to select and separate the relevant from 
the irrelevant and the important from the unimportant. We have 
used questions where every fact counts in arriving at the conclu- 
sions. But, in general, we have tried to steer a course which requires 
some fact selection and weighing but not as much as must be per- 
formed on the rambling account of successive outrages which a client 
frequently thrusts upon his attorney, particularly a young attorney. 
We believe in requiring fact selection for the examinations, but in 
moderation, and we think that this moderation policy is in line with 
the minimum standards. 


Next, what about spotlighting issues? Our philosophy here follows 
from the preceding point. We believe deeply in the standard that decep- 
tive questions should not be asked. This means that issues should not 
be buried or hidden. On the other hand, in general, we are opposed to 
spotlighting because this impinges upon the objective of having a 
question which demands analytical thinking. Yet, if the problem in- 
volves some issue which one might well miss, we may feel it advisable 
to spotlight that issue by directing a portion of the interrogatory 
toward it, thus forcing the candidate to direct his attention to it. 


The interrogatories, of course, are a tremendously important part 
of the question. We use all kinds and types depending upon the prob- 
lem composing the body of the question. These range from the general 
“Discuss the issues,” “What are the rights of the parties” to the spe- 
cific “Can A recover from B,” “Is A’s mortgage valid” back to “If A 
was your client, what advice would you give him.” Obviously, as I 
have already stated, issues can be blocked out or can be spotlighted 
through the interrogatories. We do not believe in one single pattern 
for the whole examination. We suggest interrogatories should be ques- 
tions which would not be unnatural or strained so that the student 
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will feel that he is in a real world answering real problems for real 
clients. On the most recent critique of our last July examination a 
professor of a leading law school said: “Why not get a little more color 
and imagination into your interrogatories; for example, instead of 
saying how would you advise your client—say “How would you play 
this one?” Frankly, if we did this, I do not know just how the students 
would play it, because I do not think they would know what we intend- 
ed to ask any more than I know what the learned professor meant by 
his kindly criticism. I say again the form of interrogatory must 
depend on the type of the problem contained in the body of the ques- 
tion; and must always be fair and as clear as clear can be. 


Speaking of clarity, what about designation of parties? We use 
letters—the same system employed by the Restatement; for example, 
A. agent, P. principal, T. third party, S. seller, B. buyer, etc. In cases 
where the party is less easily designated, a letter is used to symbolize 
his capacity; for example, F. for father, W. for wife or widow, etc. 
The board feels this is best because it saves the writing of the name 
over and over again and it is a shorthand system the boys have gotten 
used to in their law school training. Personally, I am not so sure about 
this. In many instances the letter form bothers me. Frankly often I 
cannot keep the parties in my head, and I have to write out a cast of 
characters at the top of the question. I have a feeling that our system 
can be improved in this respect. Names and positions are what we deal 
with in practice. Maybe we should use them on the examinations, or 
at least some combination of letter, name and position. The comic strio 
Dick Tracy with its unforgettable Flattops, BO Plentys, etc., may have 
a hint for us in this line that would make identification of parties easier 
for the examinees. 


Now what about Statutes? We have tried (so my associates tell 
me) in the past to give applicants statutes (for example a printed copy 
of the NIL for reference) during the examination, but the experi- 
ment was not popular and did not work well. It took too long to look 
up a point and to dig out the pertinent from the mass of irrelevant 
material. Now, if we have a construction of statute point, as we occa- 
sionally do, we quote the statute in the question. And the quotation 
may be not of a real but a hypothetical statute. This has proved fairly 
satisfactory. There are, however, certain basic Pennsylvania statutes 
of which we expect the applicants to have a workable knowledge and in 
consequence we make no mention of them in the question. In sum, we 
generally avoid problems involving statutes unless the statutes, in 
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our opinion, are of a general or very fundamental nature and should 
be well known by all Pennsylvania lawyers without resort to the 
books. In such cases we neither quote from the statute nor refer to it 
in the question. When we get out of that area, the statute or an excerpt 
from it goes into the question. 

It all comes back to the common sense and wisdom of the board 
and the time and effort it gives to the task with the aid of an intelligent 
forward looking staff, balanced with young attorneys and new ideas 
kept in reasonable bounds by the supervising examiner and the board. 
There is always room for improvement, but where there is integrity 
and objective idealism, there is hope for improvement—and we think 
we see progress in our work. We can only hope our bench, bar and 
the law schools also see what we think we see. 

Moperator WuitTmoreE: Thank you, Mr. Scott. We are particularly 
grateful for your willingness to join with us today. 

Our next panelist is a distinguished Massachusetts lawyer and 
member of the Massachusetts Board of Bar Examiners, Mr. Charles B. 
Rugg. Mr. Rugg will discuss with us two general problems: first, the 
authority or power a majority of a board should have to modify or 
redraft a question over the objection of the author and the propriety 
of exercising such a power if it exists; secondly, the general objectives 
of a bar examination as applied to procedures within a board. Mr. 
Rugg. 


Remarks of Charles B. Rugg 


Member, Massachusetts Board of Bar Examiners 


Two general topics have been suggested to me for discussion. The 
first concerns the objective of a bar examination and the form of bar 
examination question best calculated to achieve that objective; the 
second, the authority or power of a majority of a board of bar exam- 
iners to require the modification or redrafting of a suggested question 
over the objection of its author. I shall consider these topics in that 
order. 

The ultimate purpose of a bar examination is to ascertain whether 
an applicant has the legal capabilities to qualify as a member of the 
bar with the many attendant duties to the Court, to prospective clients, 
and to the public. James E. Brenner in his volume on bar examina- 
tions has precisely defined this purpose as follows: 

“Bar examinations should test not information and memory, not 

experience, but the applicant’s ability to reason logically and to 

make an accurate legal analysis of the problems included in the 
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examination, and then to make a sound application of the basic 
principles of the law to the facts.” 


This concept is excellent and correctly states the best way of 
measuring what to my mind is the critical aptitude that makes a good 
lawyer. Neither law firms in hiring newly admitted members of the 
bar, nor clients in selecting counsel in the more mature stages of one’s 
professional career, look primarily to what a lawyer knows. Rather 
they seek one for his proven capacity to learn. The quality of a clear, 
open and inquiring mind marks the better members of the bar. 


A bar examination question that meets Mr. Brenner’s definition 
permits the applicant to demonstrate these qualities. So far as content 
is concerned, it excludes the category of questions designed to test 
only the applicant’s memory and informational knowledge. This group 
consists principally of the so-called objective type of question, which 
can be answered “yes” or “no,” or with a short sentence or two. Mem- 
ory and knowledge are important and certainly should be considered 
in marking a question. But I believe their primary importance is as 
background for a more reasoned and logical attack upon a new problem. 


“One point” questions are to a lesser extent subject to the same 
objection. Such a question frequently results when a recent decision or 
a case arising in one’s own practice is taken as the basis without much 
modification or amplification. Such a question invariably limits the 
display of analytical ability. Resolution of the single issue often depends 
upon knowledge of a particular and sometimes technical point of law, 
and the applicant is placed in the position of succeeding or failing on 
his treatment of that single issue. My experience is that a problem pre- 
senting several distinct points of broader scope is a better test of under- 
standing and general qualification and is much fairer to the applicant. 


So far as the form of presentation of the question is concerned, 
a logical arrangement of the facts is essential if we are reasonably to 
expect logic in the answer both in the analysis of the facts and in the 
discussion of the law. A chronological inversion of events should be 
avoided as an unnecessary contribution to confusion. The factual prob- 
lem should have some claim to reality. It should not be cute but still 
should not present the issues in an obvious manner. There is, of 
course, no excuse for the trick question or the completely buried 
issue—but the factual presentation should be such that the applicant 
must recognize the issues through analysis of the facts rather than 
through an easy association with a familiar, stereotyped situation. 
Aside from that, I find that one of the pitfalls in composing my own 
questions, as well as in scrutinizing those of my colleagues, is to dis- 
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cover that an essential fact has been omitted. Although it is temptingly 
easy to insert it near the end of the question, it is frequently wiser to 
redraft completely the question so as to include it appropriately in 
the normal development of the facts. 


Another danger is the framing of a question unwittingly contain- 
ing a built-in side track, with the result that many applicants are 
diverted from the issue which was intended to be posed. It is frustrat- 
ing and discouraging to compose a problem on the Rule against Per- 
petuities and discover in grading the answers that a majority have 
construed the question as one on the Statute of Limitations, or possibly 
in a less analogous field. 

These are obvious defects of which we are all conscious. They are 
faults which frequently result from a lengthy and concentrated com- 
positive effort involving many revisions. In this process the author of 
a question is prone to become so intrigued with the core of the prob- 
lem that he tends to slight the important details of arrangement, 
phraseology and grammar, with the consequent danger that the prob- 
lem may be so presented as to cause the average applicant to miss the 
forest for the trees. It is in this field that the criticism of the board is 
most helpful. 

This brings me to my second topic, whether a member of a board 
of bar examiners has a right to insist on the content or the wording of 
his own question. What control can or should the board exercise over 
the phraseology, arrangement, grammar and content of a proposed 
question? 

Obviously there is no answer precisely applicable to fifty odd 
jurisdictions. The genealogy, the powers and the authority of each 
board of bar examiners differ. I can speak only of Massachusetts. 

In our Commonwealth the board is a unit and functions as such. 
Each member’s individual convictions are merged into the composite 
judgment of the board. The statutes and rules refer only to action by 
the board. In the absence of authoritative restrictions, the general rule 
is that a majority of a board is a quorum and that a majority of the 
quorum may act in the name of the board. Consequently the board 
is omnipotent and has the power to ignore the insistence of any member 
on the phraseology or content of any proposed question. 

The fact that this power might be exercised by completely re- 
jecting a proposed question and adopting another stimulates no doubts 
in my mind as to its propriety or its soundness. The only circumstance 
under which this situation might arise is when there is an obstinate 
and officious member of the board—a circumstance with which I have 
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no personal familiarity. Such stubbornness is far different from an 
earnest pride of opinion and a sincere and even zealous advocacy of it. 
When carried beyond an indefinable minimum, except where funda- 
mental principles are involved, it is generally an indication of weak- 
ness. Such action calls to mind the wisdom of the ages as recorded in 
Holy Writ where the Lord hardened the spirit of the King of Heshbon 
and made him obstinate that he might be delivered into the hands of 
his enemy. 


This extreme aside, the wisdom of exercising this power and the 
manner of its use pose other problems. An embryonic bar examination 
question is a most flexible commodity. Generally speaking, there is 
ample opportunity to mold and shape it within its original bounds 
without distorting the concepts of the author. The writing of a question 
designed to test the legal capabilities of an applicant to the bar is not 
a precise science. Informed opinions honestly differ as to the phrase- 
ology, grammar, form and even content of a proposed question. As we 
all know to our humiliation, frequently the results of many of our 
most earnest efforts compare unfavorably with those of some of our 
less labored but more inspired ones. A sympathetic approach and 
respectful courtesy in criticism promise greater success than an abrupt 
and blunt assertion of error. All reasonable efforts of persuasion 
should be exhausted with a constant awareness of the possibility of 
the other fellow’s being right and you being wrong. An abiding con- 
viction that the challenged question fails to conform to the standard 
set by the board should exist before the ultimate power is exercised. 
I am persuaded that all this can be accomplished in the overwhelming 
majority of instances, if not on every occasion, without resort to the 
dominion that the majority has. 


Again I emphasize that this statement of the law appears at the 
moment to be the rule in Massachusetts. It could easily be altered by 
a rule of the board, approved by the Supreme Judicial Court, or by a 
rule initiated by the Court. I am not familiar with the situation in 
other states, and I am not suggesting my analysis applies elsewhere. 
As to my comments on the propriety of positively asserting any power 
the majority may have, I assume human nature in New England and 
in the rest of the country is similar. No caution is required as to the 
geographical applicability of the comments of that character. 


Briefly summarized, a board of bar examiners should be vigi- 
lantly alert in reviewing suggested questions to insure that they are 
calculated to require the applicant to demonstrate his ability to 
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analyze, to reason and to reach a conclusion in accordance with estab- 
lished and relevant legal principles. Each question should further be 
critically examined to insure that the factual presentation is logical, 
realistic and understandable, and that the issues presented are satis- 
factory in number and difficulty to allow reasonable consideration by 
the average applicant in the time allotted. 


All this is much easier to propose than to accomplish. It is indeed 
much easier to accomplish alone after a thorough consideration of 
various aspects in the particular field of law than it is to detect the 
failure of others to reach the desired result, in a relatively brief con- 
ference of a board of bar examiners. Notwithstanding this difficulty, I 
think this function of review and criticism by a board of bar examiners 
is not only a helpful one in the preparation of a bar examination but 
also a necessary one by which the board as a whole should have the 
right finally to decide upon the merits of bar examination questions. 


Moperator WHITMORE: Thank you very much, Mr. Rugg. 


Our final speaker is the president of the Board of Bar Examiners 
of the State of Missouri. Mr. Oliver, we are anxious to hear how you 
handle these problems in your state. 


Remarks of John W. Oliver 


President, Missouri Board of Law Examiners 


Chairman Powers posed some rather direct and particular ques- 
tions when he requested the panel members to participate in a discus- 
sion of the general question relating to “Critiques of Questions within 
a Board.” The answers to those particular questions are not too diffi- 
cult to find but those answers raise still further questions that require 
most thoughtful consideration. 


When the five members of the Missouri Board of Law Examiners 
were polled, rather universal agreement was noted in regard to the 
particular questions raised in Chairman Powers’ letter. We in Mis- 
souri are agreed, as probably are most of you, that ideally there prob- 
ably should be a critique by a board of all questions before those 
questions are included in an examination. But, as one of my col- 
leagues put it, his judgment was based on “how we would like to 
run things if we had the time to do everything we would like to do.” 
Another of our board members qualified his affirmative answer with 
the statement: “If limitations of time and energy would permit.” Not 
one of our board failed to raise the question of how, as a practical 
matter, could the ideal be realized where the only aid and assistance 
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are the five busy, practicing lawyers themselves. Frankly, we do not 
know the answer. Nor are we sure of the direction that we should take 
in order to find it. 

The corporate judgment of our Missouri Board is that the ques- 
tion of how much right should an individual examiner have to insist on 
the context of his own questions and the related question of how large 
a control should a board exercise over phraseology, arrangement, 
grammar, and good taste, are not questions that would present any real 
or lasting problem if the primary question of time and energy could 
be solved. 

Our board likewise demonstrated almost universal agreement as 
to what it conceives are the objectives to be obtained by bar examina- 
tion questions and the relationship of those questions to law school 
questions. While none even so much as referred to the Consultant’s 
Report on Bar Examinations and Requirements for Admission to the 
Bar, they, in effect, paraphrased the ninth recommendation of that 
report which Mr. Scott has already quoted: 

“The primary objectives of a Bar Examination should be to 

test the applicants’ ability to reason logically, to make an ac- 

curate legal analysis of the problems included in the examina- 
tions, and to demonstrate a thorough knowledge of the funda- 
mental principles of the law and their application.” 


Bar examinations should not be designed primarily for the pur- 
pose of testing information, memory or experience. 


We, of course, are opposed to “one point” questions; we do not 
like to have questions that are too hard or too easy; questions that are 
too short or too long; or questions that are too simple or too compli- 
cated. Like the Very Smallest Bear, we want our questions to be “just 
right,” but, again, we are at somewhat of a loss to know just how to 
attain that end. 

Our experience with one-point questions terminated rather radi- 
cally when the question was “Define double jeopardy.” One applicant 
responded: “Double jeopardy is defined as follows: Jeopardy is any 
act admitted by a jeopard. Double jeopardy is any act admitted by two 
jeopards.” 

Any serious discussion of the question of a critique by an entire 
board must be based upon the basic assumption that someone other 
than the examiner should review and weed out improper questions. 
We in Missouri believe that theoretically this is a valid assumption 
and my discussion of the problem rests upon assuming the validity 
of that assumption. 
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But, as Missourians, we have to be shown how a critique within 
a board can be accomplished. And we say that you have not shown us 
when you point to systems in effect in states like California, New York, 
Pennsylvania and Michigan which Herbert Clark reports as spending 
from $90,000 to $40,000 respectively each year on the examining 
process. Nor do we believe that we have been shown when we are 
referred to Shelden Elliott’s report which notes that in the states of 
California, Massachusetts and Pennsylvania the burden of grading is 
shifted almost entirely to specially employed assistants, thus freeing 
the board members of at least one tremendously time consuming 
burden so that their energies can be devoted to critiques and other 
important duties. Theoretically I am presently on vacation. I have 
195 bar examination papers in a separate suitcase and my schedule is 
two hours a day. 

We suspect that there are persons in our state who would wel- 
come some surefire suggestion as to how the state of Missouri could 
be induced to spend the kind of money that is necessary to support 
a program similar to those mentioned, but we on the Missouri Board of 
Law Examiners are of the opinion that no such suggestion would bear 
much immediate fruit. 

So where are we? The most experienced member of our board 
wrote in response to my letter on this subject that he has “always 
contended that the difficult part of being a good bar examiner is the 
preparation of the questions.” And we on the Missouri Board not 
only agree with him—we also agree that some sort of an experienced 
and expert critique would improve the questions that we give on our 
examination. 

But our board in Missouri, like probably most other boards not 
blessed with exceptional financial support, find that there are simply 
not enough hours in the day to take the additional time from extremely 
busy practices to carefully check and criticize our fellow board mem- 
ber’s questions before each examinatior. 

In the course of preparing for this discussion I found that the lit- 
erature abounds with discussions of a National Bar Examination. 
Quite frankly, I had never given the matter any very serious con- 
sideration because I never could see just exactly who was going to 
pay the bill. Nor, after some recent consideration, am I in any way 
convinced there is a real answer presented by a National Bar Exam- 
ination. But the more consideration that one gives this business of 
critique, the more he recognizes that what is being sought is an expert 
review of the questions by persons other than the individual examiner 
before those questions are given on a particular examination. 
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It is suggested that all alternatives for attaining that basic ob- 
jective are not exhausted should one reject the concept of a critique 
by a particular examining board. Obviously a properly prepared Na- 
tional Bar Examination would be prepared according to that technique 
and would attain the objective but is it not equally obvious that we in 
Missouri could probably get ourselves properly financed to do the 
critique function for ourselves long before we could ever expect to 
see a full blown National Bar Examination system in actual opera- 
tion? 


But is there not a middle ground that might afford a still third 
alternative? 


The Bar Examination Service Committee represents a selection 
of questions, some of which have already received a full board 
critique, and all of which receive at least a one man critique when the 
individual examiner reviews the questions that he receives from the 
Service. 


Could we suppose that there are several states situated somewhat 
like our state of Missouri which have boards composed of actively prac- 
ticing lawyers who would like to experiment with the critique theory 
but who do not have the time to do so? Would it not be possible for 
the boards of these several states to lend their good offices to do a 
little experimenting that might prove helpful even to those who 
advocate the eventual adoption of a National Bar Examination? 


Concretely, would the Bar Examination Service Committee, with 
the aid and assistance of possibly another committee of the Conference, 
select what they conceive to be a proper national examination for such 
universally given subjects as Contracts, Constitutional Law, Evidence, 
Real Property and Torts, and suggest a form of examination for each 
of those subjects. Details, such as the time allotted for examination, 
the number of questions to be given, the obvious problem of security, 
and a good many other equally important details, would have to be 
carefully worked out, but I think the germ of the idea is stated in 
what I have said. 


Perhaps not all of the forty-eight states would give all of the 
subjects, but there should be a large enough participation, say even by 
ten states, for one to see not only how bar questions prepared by the 
critique process compare with questions not so prepared, but it would 
also give a body of concrete information as to how each of the respec- 
tive boards were grading in relation to each other. “Do we grade too 
easy or do we grade too tough” are questions that I suppose are asked 
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by boards other than the Board of Law Examiners for the State of 
Missouri. 

It would not seem that a particular board could object too strenu- 
ously to the experiment on the basis of a possible violation of state’s 
rights because most of the states are already using the work of the 
Service—and are liking it. Further, we would suspect that those 
states that have reasonably large classes of applicants for examinations 
share our Missouri experience of giving an examination to students 
who have been educated nationally rather than locally. In our June 
examination this year, for quick example, we examined students from 
no less than twenty-five law schools, only four of which were located 
in the State of Missouri. Our most distant applicant was from the 
University of San Juan in Puerto Rico. 

Like a true bar examiner, I have not answered any questions, but 
have asked some. To pass the course, one need only answer the ques- 
tion of whether it might be possible for the Bar Examination Service 
Committee of the National Conference of Bar Examiners, assisted by 
possibly another committee of the Conference, to perform the function 
of criticism as an experiment with a group of states on a voluntary 
basis to see whether it is worth the candle to spend further time and 
energy in pursuit of this idea. 

Having posed a question, even to such a learned group, the cold 
breath of experience reminds this bar examiner that he never knows 
whether he has written a good question until he begins to read the 
answers. 

Mopberator WuHitTmMoreE: Thank you, Mr. Oliver. 

You have heard many suggestions and comments and ideas and 
facts. Perhaps you have comments or questions. The meeting is now 
open for them. 


General Discussion 

THomas H. Apams of Detroit, Michigan: I would like to say I 
am very glad to have our Michigan Board placed along with New York 
and California. I wish we were in that class; we are not. 

My question is directed to Mr. Rugg in connection with this 
matter of how far a board should go in criticizing another member’s 
question. Is there not a point beyond which you cannot go? If you 
cannot convince the author that he is wrong, have you not got to let 
him go along because he has to eventually correct that question him- 
self in a state like Michigan, and I assume in Massachusetts you read 
your own questions? 

Mr. Rucec: That is right. We have our own readers read them. 
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Mr. Apams: In Michigan the man himself does the reading. 
There it seems you can only suggest what changes should be made. 
If you cannot convince him, the board never should exercise authority 
to change the question. 

Mr. Ruce: Let me answer it by asking you one. Supposing the 
question really was very bad, it was lousy. Would you let it go as a 
board question? 

Mr. Apams: Well, fortunately we have never had one that bad. 
We have always been able, if our objection was sound, to convince 
the examiner that he was wrong and he has rephrased his question; 
but it seems to me that the man who is going to read that question and 
grade it has to have a great deal to say in the way that question is 
prepared. 

Mr. Ruac: The ultimate power will only come into play when 
you have a superlatively obstinate and contumacious member of the 
board. If you have that kind of a character, I think the board can and 
should exercise its power. 

Mr. Apams: Perhaps there will be some difficulty with that man 
when he comes to grading that question afterwards. 

Moperator WHITMORE: Do we have other questions or comments? 

Joun A. Buake of New York City: I go along wholeheartedly 
with the Massachusetts members that the board is responsible for what 
is on the examination as a board. In New York we would never put a 
question on the examination unless all three members—which in- 
cludes John DeGraff—were in favor of it. 

What I am concerned about is that the board should not let a 
poor question remain in the examination. They should veto a question 
they do not want. All right. But suppose a minority of three thinks 
that a particular question should not get on the examination and the 
drafter of the question is outvoted? What are his rights in Massa- 
chusetts? 

Mr. Ruee: I think his rights in Massachusetts are zero. We have 
a board of five. A minority would be two, and I think the two are out 
of luck. If three go for it, that is it. 

Mr. Buake: There is an old story I was told when I came on the 
board after Mr. Clark, who is here somewhere. I was told a story that 
he probably remembers. There was a great disagreement among the 
three members of the board. John DeGraff was not on the board yet 
at that time either. Among the three members great disagreement 
prevailed, and finally Mr. Sanford, who was then the member from 
Albany, said the question could only be used provided there was 
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printed at the bottom of the question, “This question is used over the 
objection of Mr. Sanford, a member of the Board.” 


Moperator WHITMoRE: Do we have other comments or questions 
of any of the panel members? 


JoHN KirKLAND CLarK of New York: Mr. Chairman, may I have 
the opportunity to say a word? I have been blessed with five children; 
my wife and I have lost only one, and we never have been able to 
determine which one we are proudest of, and the youngest is over 
forty. But may I say that the National Conference of Bar Examiners 
was a child of mine, and I am very proud of the way that child has 
developed and the benefit that the states, the nation, and legal edu- 
cation have derived from it. 


I want to express my pleasure that the standards are kept so 
high. Having passed on 45,000 candidates in New York during my 26 
years on the Board of Bar Examiners, I know pretty well the problems 
that you are discussing here today. 


The remarkable thing is that we had in New York a board which 
served for twenty-six years together, one member from Buffalo, one 
from Albany, and one from New York City, and we were very much 
interested in the creation of this organization which I think has amply 
fulfilled our ideals and desires to have a wider knowledge of the 
experience of the members of examining boards in the several states. 


It was a tremendous job here in New York. I suppose three- 
quarters of the lawyers practicing in this state are my errors, as I 
always greet them, but we operated very successfully together, each 
one of us having an assistant. 


Bar examiners are a pretty nice crowd to work with, as I can 
see by looking around this room and hearing the discussions. 


I am delighted and very proud and happy that the child of the 
Section on Legal Education has developed into such a valuable mem- 
ber of the legal community, and I thank you for your share in that 
work. 


Moperator Wuitmore: Mr. Clark, we are certainly deeply in- 
debted to you and appreciate the opportunity of joining with you here 
at the annual meeting of the National Conference of Bar Examiners. 


To each of our panel members, Messrs. Nighswander, Worsham, 
Godfrey, Rugg, Oliver, and Scott, we are indebted and certainly ap- 
preciative of their well-considered and scholarly comments. On behalf 
of the National Conference may I thank each of you. 
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Progress of Bar Examination Service Committee 


NUMBER OF QUESTIONS DISTRIBUTED TO EXAMINERS 


August 16-31 _... 


September ............................ 


ea 
November ..... 
December ~................... 
January ..... sasiiceiaceis 
February ............... 

_ areas 


ences ee 


_. {ease 
June ...... aad 
| eee 


MN I aerate 


APPENDIX I 
1956-1957 1955-1956 
phneentiic 70 0 
dpsestaeebiad 67 38 
piatkoesiee 61 72 
Pa deacaes 22 14 
ecole 60 82 
dete 143 76 
87 51 
sacinegee 91 48 
be 37 74 
sciicssdeestinaee > an 131 
igstocmantes 69 117 
109 81 
5 7 
953 791 


1954-1955 1953-1954 
74 
77 
0 
33 
66 60 
99 123 
46 46 
39 0 
44 40 
117 31 
91 60 
84 33 
47 0 
817 393 


Grand total of questions distributed by the Committee from beginning of operation 
(December 1, 1953) to August 15, 1957: 2,954. 


APPENDIX II 


JURISDICTIONS WHICH HAVE ORDERED QUESTIONS 


From August 16, 1956, to August 15, 1957, examiners and boards from the 
following 33 jurisdictions have drawn on the Committee’s question pool one or 


more times: 


Alabama 
Arizona 
Delaware 
Florida 
Georgia 
Hawaii 
Idaho 
Illinois 
Iowa 
Kansas 


Kentucky 


Maine 
Michigan 
Minnesota 
Missouri 
Montana 
Nebraska 
Nevada 
New Hampshire 
New Jersey 
New Mexico 
New York 
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North Carolina 
North Dakota 
Ohio 
Oklahoma 
Oregon 
Pennsylvania 
Rhode Island 
South Carolina 
Utah 

Virginia 
Washington 











Examiners in 46 jurisdictions have drawn on our pool since we began 
distributing questions in December 1953. Of this number, examiners in the 
following 38 jurisdictions have ordered more than once: 


Alabama Kentucky North Dakota 
Alaska Maine Ohio 

Arizona Michigan Oklahoma 
Arkansas Minnesota Oregon 
Colorado Mississippi Pennsylvania 
Delaware Missouri South Carolina 
Florida Nebraska Tennessee 
Georgia Nevada Utah 

Guam New Hampshire Virginia 
Hawaii New Jersey Virgin Islands 
Idaho New Mexico Washington 
Illinois New York Wisconsin 
Iowa North Carolina 


Examiners in the following three jurisdictions have ordered once, for the 
first time, since August 1956: Kansas, Montana, Rhode Island. 


The following five jurisdictions have ordered once but have never re-ordered: 
District of Columbia, Indiana, Massachusetts, Puerto Rico, Texas. 


The remaining eight jurisdictions have never ordered questions from the Com- 
mittee: *California, Connecticut, Louisiana, Maryland, South Dakota, Vermont, 
West Virginia, Wyoming. 


*Contributor to the Committee’s pool. 


APPENDIX III 


NUMBER OF QUESTIONS ORDERED FROM COMMITTEE 
FROM AucusT 16, 1956 To Aucust 15, 1957 
(By Subject Classification) 


Administrative Law ......... De neecicnads 5 Legal Ethics ...... ES Rea eee 11 
NE GE ee een 39 Municipal Corporations «0.0... 1 

Bills and Notes ............... sesseseeeees . 50 Partnership .......................... esse hae ee 

Community Property ............. 3 Personal Property ...... ' i 

Conflict of Laws ........... mci 9 
Constitutional Law ~..........000............ 72 Real Property 66 

Contracts ............ Pie en Ae Nein, Sn eS MNT Peete baer 

oo nn | Sales anys nc a Pe nonin 

Creditors’ Rights 0.000000. cccccccsecs-eoo-- gy — SOCUrrity nnn anne eenceeen cere i 
nee 66 Statutory Construction ....................... 2 
Oe Se SRE SE bere cee aie een mr 13 

Domestic Relations ...............---- 6: 2a... ica cae yam nc tinar oessat aes 50 
Re eee ee eee oan enema ere acceeere 30 

Evidence ................ eee eee — ae ahaa 36 i 
Federal Jurisdiction 0.0... 19 Multiple-Subjects 00.02.2000... 10 
eee NER tee 2 13 ae | 
a ee 0 953 ' 


APPENDIX IV 


NuMBER OF TIMES QUESTIONS Have BEEN ORDERED FROM COMMITTEE 
SINCE THE BEGINNING OF OPERATION (Dec. 1953) * 
Total Number of 
Questions Ordered 
OO 3. a sna cao a aR es a aes eae 534 
Re re ee scsciVeaisstasteniee a tee eantae a ‘ ceed 588 
ee eee ain eae Pa Ee CARE ey ae OT 328 
Three Times ..................... Rie rest ssn cesses cab og haath casei eochcgies coment 193 
ge Ee ee eae ees ee RE Paes ee es 103 
oe ee Be Se eR eR - 52 
RN gt ee Ee Seer ee ta ee 35 
Seven Times ....................0.......... : SEIS Oe: EN mete 15 
Eight Times .............. pbscbent seta nccitls il ea ahs oa to a oe Wh 10 
Nine Times ................... i earesetieaimrabecaeteie tie Sa dit act RaSh ee Aa 
TE MO Sat Pere OE 
More than Ten Times @02.0.000000000000000.00000.0cceececeeeeeee 


or 


*The Committee warns examiners ordering questions of prior use in other states. 


APPENDIX V 


QUESTIONS (WITH ANALYSES) CONTRIBUTED DuRING THE PERIOD, 
Aucust 16, 1956 ro Aucust 15, 1957 


Ceiseteia  .......<................. piteniecteisstitioes A ect EE eS 
NNR cineca sscoicgs seccnccndineiaiavinciaswcmin ni sagiltcnte seccievente be dais, acres a 
RN alee. ‘iihevansatsstiealeuiics curiae’ Waesdldietdassenactetcasendereniccs Uisizsghsiebettanncipeatee 63 
Aer intasteeptiwatanct erage SO RN AE OR EE ee 
I aise csistecsecacininnsnds insane a Se NM Se ne OIE EN ME NOE, Fe 160 
NN cs ict alisaas apnea Peaccpciacictisblas tale Det Ree Rea CR PE 
Massachusetts _.............. ee ee ar aR oer TS Se SN PRR eRe eee RE 4 
PIN cise ca cesccsscesscossince samy eg i cle cil see a e e ee gs 
i ne ee ee ee ee ee Se ONT ee Cee Dstt Ean tgs 1 
New Jersey ................ si Encascebenbaneagae TENE LTO A OEE ERE = NCL OTE SE ae 28 


I hc ie a el ee ee ees geben ees 49 
Ee Le DE DS LN I ODT RY Not a iba aby 34 
MN ai a ile ss ae NI eee 13 
REE Ae ve ee ce eer EE IE 
Washington ............................. ut dia tiaencied age eae SD en ea ae PENN Ie ON ee 12 
mms Cay: cr a) a ak ce 1 








APPENDIX VI 


ANALYSIS OF THE COMMITTEE’S QUESTION Poot as or Aucust 15, 1957: 


NuMBER AND PERCENTAGE OF QUESTIONS BY STATE OF ORIGIN 


State 


Alaska 


California 


a 


Georgia ...... 
Hawaii ...... 
See ..:....-:..: 


Illinois ................ 


Indiana ................ 


Iowa 

Maine ..... 
Massachusetts 
Michigan 


Missouri ..... 


Nebraska ............ 


Nevada ...... 


New Hampshire .......... 


New Jersey ..... 
New York 
ae 
Oregon ...... 
Pennsylvania 
Tennessee 


Virginia 


Washington ........ 


Wisconsin 
Anonymous 
Schools 


Total ...... 


Total Number of Questions 
in Pool from 


Source Indicated 


40 


8 
320 
192 

73 
33 
14 
252 
57 
11 
71 


18 


oo 


210 
196 
18 
41 
61 
28 


22 


16 
31 


1,865 


% of Questions 
in Pool from 
Source Indicated 

AQ% 
17.2 
10.3 

3.9 
18 

8 

13.5 
3.1 
6 
3.9 

A 

9 

a 

5.3 

A 

3 
11.5 
10.5 

1.0 
2.2 
3.3 
15 
3.3 
‘3 


1.6 
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ANALYSIS OF REQUISITIONS FROM POOL, By CONTRIBUTING SOURCE 
OF THE QUESTION ORDERED—DECEMBER 1, 1953, ro Aucust 15, 1957 





Total Number of Questions % of Orders of 

Ordered from Questions from 

State Source Indicated Source Indicated 

, ene sta ah tae cata 4 1% 
i NL CELE TS RE 758 25.7 
I, Ser eee al cad, Sasol 190 6.4 
WIE iss chain tisccienttnereetla i 92 3.1 
I voaashnc ie aap siteariateantilenatecctay 22 a 
HIN focissccadcenccitel conic hwemntacnesich 18 6 
ARES ee eee ee 425 14.4 
Indiana ....... cena npvicaiceetieiabhaimeaitasalh 49 1.7 
DN. isis vasnsecbancenceletassohanineceschcataalac 41 1.4 
i NR rene 63 2.1 
Massachusetts _22.....2.-22..2:2-.c0e1eee---e- 10 3 
EN, een eee ee 20 7 
RN LE RE ST OE 2 P 
Nebraska .................. spel iseniainsbacstaas 145 4.9 
TEE 3 Se ET RE a 3 a 
New Hampshire ........2000.00.00000020....- 3 p 
NN I ses tacciccsaisrtesciclcrectacnspaienceecs 253 8.6 
NE I istencsttottienatiacantes 373 12.6 
ee NEI Oe CT 35 12 
rer a eee SC 49 if 
RNIN in ccseessckastntnsbielccwanonna 163 5.5 
TN, ess hh eee aed 33 1.1 
REPEC aaa Pe TRE eer 44 15 
ois aaa 27 9 
lo ES SITE ARE TT ST 12 A 
I iis bhi estsckmape 25 8 
SII satcicornistessiotieraienseemnaiticoceh 95 3.2 
IRR ete aes ee 2,954 
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Admissions to Bar by Examinations in 1956 











1956 Number Number Percent Total Total Percent 
State Examination Taking Passing Passing Taking Passing Passing 

Alabamn......................-- February ........ 20 12 60% 

(gee 19 16 84% 39 28 70% 
0 ae ee January .......... 11 9 82% 

SS 63 53 84% 74 62 84% 
Peieomnes:......-...:- I sisseciceSoies 19 14 74% 

as 7 5 711% 26 19 73% 
California............:.........1 March .............. 529 301 57% 

September 832 432 52% 1,361 733 54% 
Cleene...........  e . 103 78 76% 

December 82 60 73% 185 138 75% 
Connecticut..................Jume  ~.....-........- 169 125 74% 

December ........ 100 82 82% 269 207 17% 
Delaware..................- September ...... 24 19 79% 24 19 79% 
Dist. Columbia............. ar 462 255 55% 

December ........ 333 189 57% 795 444 56% 
NN essere March. .............. 172 133 77% 

__ eee 226 170 75% 398 303 76% 
TO! [oe 360 83 23% 360 83 23% 
_ REE peeeerene Apel ................ 8 8 100% 

September ...... 19 11 58% 27 19 70% 
EAT. ee 312 184 59% 

September ...... 574 360 63% 886 544 61% 
Se —» s/n 60 51 85% 

October  .......... 100 98 98% 160 149 93% 
eee Ene 74 74 100% 

October .......... 19 15 79% 93 89 96% 
RN Ee February ........ 56 56 100% 

eee 51 50 98% 107 106 99% 
Rentucky..................... Maren. .............. 29 28 97% 

NE Sesceiacnsses 51 50 98% 80 78 98% 
Louisiana................ March .............. 9 2 22% 

__ eee 33 11 33% 42 13 31% 
Ree February ........ 14 6 43% 

August .......... 27 18 67% 41 24 59% 
/ |” eee March. .............. 166 68 41% 

_ eee 236 125 53% 402 193 48% 
Massachusetts.............. [ aes 475 235 50% 

December ...... 295 137 46% 770 372 48% 
oh... a 313 244 78% 

September ...... 276 207 75% 589 451 717% 
Minnesota.................... eens 68 46 68% 

> EEE 138 99 72% 206 145 70% 
Mississippi.....................February ........ 7 2 29% 

fae 19 8 42% 26 10 38% 











Admissions to Bar by Examinations in 1956 











1956 Number Number Percent Total Total Percent 
State Examination Taking Passing Passing Taking Passing Passing 
Missouri.................. ......February ........ 87 71 82% 

Ne oe. 138 114 83% 225 185 82% 
Montana... October .......... 16 12 75% 16 12 75% 
een ee February ........ 8 8 100% 

ae 38 38 100% 46 46 100% 
ae ee September ...... 29 22 76% 29 22 76% 
New Hampshire.......... pO eee 31 15 48% 31 15 48% 
New Jersey...................January .......... 70 33 47% 

Sees 93 55 59% 

October .......... 155 89 57% 318 177 56% 
New Mexico...... — (amen 14 10 71% 

August ............. 28 24 86% 42 34 81% 
New York................ fc eee 776 329 42% 

eee on. 1,619 867 53% 

November ....... 863 388 45% 3,258 1,584 49% 
North Carolina............August _.......... 130 118 91% 130 118 91% 
North Dakota............... | | eee 26 26 100% 26 26 100% 
aera shea February ........ 281 172 61% 

| ae 493 285 58% 774 457 59% 
Oklahoma...................... February ........ 41 34 83% 

ponte 100 92 92% 141 126 89% 
ne == 139 107 77% 139 107 771% 
Pennsylvania........ a 229 103 45% 

| ae 477 269 56% 706 372 53% 
Rhode Island................March  .............. 29 12 41% 

September ...... 43 27 63% 72 39 54% 
South Carolina...... oats 47 33 70% 

November ...... 26 21 81% 73 54 74% 
South Dakota............... | Spennentes 2 2 100% 2 2 100% 
Tennessee...................... February ........ 74 52 70% 

ee co, 80 59 74% 154 111 72% 
PI cnilincsdenciclentaes March. .............. 225 176 78% 

came ............. TS 157 80% 

October .......... 204 151 74% 625 484 77% 
re .. September ...... 52 48 92% 52 48 92% 
TI isicrccccvesccccnoee September ...... 12 9 75% 12 9 75% 
TR eicitscrctientoente | ee 254 112 44% 

December ..... 204 100 54% 458 212 46% 
Washington.................. January .......... 38 22 58% 

7 eee 140 106 76% 178 128 72% 
West Virginia.............. a 8 8 100% 

September ...... 14 11 79% 22 19 86% 
II sais ° RSA. 27 20 74% 27 20 74% 
EC January .......... 4 1 25% 

\ eae 20 14 70% 24 15 638% 














: eames 14,540 8651 59% 14540 8,651 59% 














First-Timers and Repeaters in 1956 











% Repeaters 
1956 to Total % Passing for Yr. 
Exami- First-Timers Repeaters Taking  First- 
State nation Taking % Pass. Taking % Pass. Exam. Timers Repeaters 
Alabama..............-. Pek. ...... 11 55% 9 67% 45% 
July ...... 16 88% 3 67% 16% 74% 67% 
Arizona................-: oe 7 86% 4 75% 36% 
July ...... 57 89% 6 33% 10% 89% 50% 
Arkansas............- March 18 78% 1 0% 5% 
July ...... 6 83% 1 0% 14% 79% 0% 
California...... March .. 220 58% 309 56% 58% 
pt. ... 653 61% 179 18% 22% 61% 42% 
Colorado...... _..June 83 86% 20 35% 19% 
a 65 86% 17 24% 21% 86% 30% 
Connecticut.........June ... 137 78% 32 56% 19% 
Dec. 65 88% 35 71% 35% 81% 64% 
Delaware............. Sept. ... 16 15% 8 88% 33% 75% 88% 
Dist. Columbia...June ... 371 59% 91 41% 20% 
Dee. ..... 217 59% 116 52% 35% 60% 47% 
Florida...................March .. 148 83% 24 42% 14% 
Jay ...... 191 83% 35 31% 15% 83% 36% 
Georgia................ July ...... 236 26% $124 17% 34% 26% 17% 
BI corse kncuss April 6 100% 2 100% 25% 
Sept. 18 61% 1 0% 5% 71% 67% 
CN ere March .. 160 68% 152 49% 48% 
Sept. ... 465 70% 109 33% 19% 69% 43% 
Indiana................ April 49 92% 11 55% 18% 
wet ..... 93 99% 7 86% 7% 96% 67% 
ere June 70 100% 4 100% 5% 
oS 18 83% 1 0% 5% 97% 80% 
ee Feb. 56 100% 0 0% 
June 51 98% 0 “se 0% 99% 
Kentucky.............. March 18 100% 11 99% 34% 
June 50 98% 1 100% 2% 99% 92% 
Louisiana............ March 4 25% 5 20% 56% 
July ...... 18 39% 15 27% 45% 36% 25% 
NN acca Mors a 5 80% 9 22% 64% 
Aug. 23 74% 4 25% 15% 75% 23% 
Maryland............ March 59 58% 107 32% 64% 
say ...... 176 64% 60 20% 25% 63% 27% 
Massachusetts.....July ...... 336 63% 139 17% 30% 
Dee. ...... 66 64% 229 41% 78% 63% 32% 
Michigan............. April 248 81% 65 66% 21% 
Sept. ... 221 85% 55 35% 20% 83% 52% 
Minnesota........... March . 26 717% 42 62% 62% 
July ...... 125 16% 13 31% 9% 76% 55% 
Mississippi....... Peo. ...... 3 33% 4 25% 57% 
July ....... 17 41% 2 50% 11% 40% 33% 

















Percent 
Repeaters 
to Total 
Taking 
1956 





31% 
14% 

8% 
36% 
20% 


25% 
33% 


26% 


15% 
34% 


11% 
29% 
11% 

5% 

0% 
15% 
48% 
32% 
42% 
48% 
20% 
27% 


23% 

















First-Timers and Repeaters in 1956 











Percent 
% Repeaters Repeaters 
1956 to Total % Passing for Yr. to Total 
Exami- First-Timers Repeaters Taking  First- Taking 
State nation Taking % Pass. Taking % Pass. Exam. Timers Repeaters 1956 
a... Feb. ...... 66 79% 21 90% 24% 

June .... 126 83% 12 757% 9% 82% 85% 15% 
Montana...... — om 12 83% 4 50% 25% 83% 50% 25% 
Nebraska.............. Feb. ...... 7 100% 1 100% 13% 

June ... 38 100% 0 ae 0% 100% 100% 2% 
Nevada.................. Sept. ... 25 76% 4 75% 14% 76% 75% 14% 
New Hampshire June ... 21 57% 10 33% 32% 57% 33% 32% 
New Jersey..........Jan. ..... 38 58% 32 34% 46% 

June ... 60 65% 33 48% 35% 

Sa 123 63% 32 34% 21% 63% 39% 31% 
New Mexico......March . 8 88% 6 50% 43% 

pe 26 85% 2 100% 1% 85% 63% 19% 
New York............. March .. 235 53% 541 38% 70% 


June ....1,272 63% 347 20% 21% 
) ee 238 50% 625 43% 712% 60% 36% 46% 




















North Carolina...Aug. ...... 115 96% 15 53% 12% 96% 53% 12% 
North Dakota.....July ...... 26 100% 0 a 0% 100% ated 0% 
Ohio........ ee ee 122 75% 159 57% 57% 

June .... 400 62% 93 39% 19% 65% 46% 33% 
Oklahoma.............Feb. ...... 36 86% 5 60% 12% 

June ... 95 94% 5 60% 5% 92% 60% 7% 
eee July .... 115 84% 24 42% 17% 84% 42% 17% 
Pennsylvania......Jan. ...... 61 39% 168 47% 73% 

July ..... 384 63% 93 29% 19% 60% 41% 37% 
Rhode Island.....March . 4 25% 25 44% 86% 

Sept. ... 32 66% 11 55% 26% 61% 47% 50% 
South Carolina..May ... 40 80% 7 14% 15% 

Nov. ...... 14 93% 12 67% 46% 83% 47% 26% 
South Dakota.....June ... 2 100% 0 a 0% 100% ae 0% 
Tennessee............Feb. ...... 56 77% 18 50% 24% 

June ... 55 83% 25 52% 31% 80% 51% 28% 
ne ee Sept. ... 49 94% 3 67% 6% 94% 67% 6% 
Voermont............... Sept. .. 8 100% 4 25% 33% 100% 25% 33% 
Viewinie.............<. June ... 176 57% 78 15% 31% 

ee. ..... 80 63% 124 40% 61% 59% 31% 44% 
Washington.........Jan. ..... 13 62% 25 56% 66% 

say ...... 126 80% 14 36% 10% 78% 49% 22% 
West Virginia...March . 6 100% 2 100% 25% 

Sept. ... 13 85% 1 0% 7% 89% 67% 14% 
Wisconsin............. July ...... 23 78% 4 50% 15% 78% 50% 15% 
Wyoming.............. Jan. ..... 4 25% 0 im 0% 

June ... 18 712% 2 50% 10% 64% 50% 8% 

Oe ese 9,266 68% 4,649 37% 33% 68% 37% 33% 








Texas did not furnish separate figures on first-timers and repeaters. 
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It’s Going To Be a Humdinger 


The program for the annual meeting of the National Confer- 
ence of Bar Examiners and the Section of Legal Education is almost 
complete. The time is August 25-26 and the place is Los Angeles. 
The grist will be: a workshop session Monday afternoon covering 
“The Mechanics of Giving a Bar Examination” and “Requesting 
and Using Character Information from the National Conference of 
Bar Examiners,” a Tuesday morning session on “Proper Bar Exam- 
ination Coverage” from the bar examiner’s point of view and from 
the law school’s point of view, and, following the customary lunch- 
eon, a session Tuesday afternoon on “The Alleged Subversive 
Applicant—His Rights and Obligations.” 


Everything is in shape for a humdinger of a meeting. By send- 
ing in immediately a request to the American Bar Association for 
your hotel or motel reservation, you will be in shape to be a hum- 
dinger too! 





Published at the office of the Director 


MarJoriE MERRITT 
520 Guaranty Bank Building 
Denver, Colorado 
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